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INTRODUCTION 


The research described herein Is directed at a long-term Investiga- 
tion of the Impact that charge-coupled device (CCD) processors porlend 
for future instrumentation. The CCD devices of Interest process sampled 
analog data and will be referred to In the sequel as OP-SAPS - operational 
sampled analog processors. 

Preliminary studies Into various architectural configurations for 
systems composed of OP-SAPS have shown that they enjoy tremendous poten- 
tial in such diverse applications as pattern recognition [1] and auto- 
matic cont ">l [2]. In addition, It appears probable that OP-SAPS may 
be used t -instruct computing structures which can serve as special 
peripherals to large-scale computer complexes used in real time flight 
simulation [3]. 


Because of the Inherent advantages OP-SAi-'S possess for computations 
of the form found very often In pattern recognition and Image processing 
systems, the scope of the research has been limited to the following 
benchmark programs: (1) Face Recognition, (2) Voice Command and Control, 

(5) Terrain Classification, and (4) Terrain Identification. Of these 
four, only the first two have received significant attention to this 
point. A small amount of effort has been spent on examining a method 
by which OP-SAPS may be used to decrease the limiting ground sampling 
distance encountered In remote sensing from satellites. 


1. FACE I DENT IF ICA' ION PROGRAM 


This problem area Involves the development of a pattern recognition 
system for facial Identification, There Is a large variety of applica- 
tions for such a system, Including control of access to secure areas, 
personnel Identification/verification, etc. 

The Initial system Is designed to handle flffy different faces. This 
constraint was Imposed to limit the amount of data gathering prior to 
establishing feasibility. The steps to be followed are: 

a. Establish a statistically meaningful data base 

b. Design feature extractor 

c. Design classifier 

d. Test on independent data, using digital computers 

e. Iterate on steps b - d as required 

f. Design CCD hardware 

g. Implementation 

At this point In time, steps a and b are being carried out. Computer 
software and hardware are available to allow acquisition of facial infor- 
mation through a standard vidicon camera. The raw data Is acquired at a 
sampling rate of 200 KHz, and each sample point Is quantized to 8 bits. 

An analysis will be carried out to determine the composite power density 
spectrum from which the bandwidth for a pre-filter and the minimum samp- 
ling rate will be estimated. The resulting system will be as shown in 
Figure 1. 

Once the required sampling rate has been determined, the next step 
involves the design of the feature extractor. The purpose of the feature 
extractor Is to make meaningful measurements on the Input samples which 
are as few in number as possible consistent with satisfactory performance. 
This step is generally viewed as performing dimensionality reduction, 
since the number of features is normally small relative to the original 
number of samples. 

Since CCD processors are well suited to perform linear transformations, 
the feature extractor and classifier will be constrained to such techniques. 
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At present. It is planned to use a version of the feature extractor de- 
fined an patented by Object Recognition Systems, Incorporated.* In 
essence, this Is a variation of scanning through an optical slit In that 
the time sequence obtained from sampling a field of the TV raster is 
divided Into a number of Intervals over which Integration operations are 
performed. The result from each Interval Is used as a feature, and the 
total number of Intervals determines the resulting dimensionality of the 
feature vector. 

Preliminary testing of this feature extractor has b^en encouraging; 
and, therefore, work will continue in an effort to determine an optimum 
number of features. At present. It appears that this number will lie 
between 10 and 32, which is compatible with planned CCD structures. 

2. VOICE COMMAND AND CONTROL SYSTEM 

An Investigation on the fecsibliity of a voice-actuated command and 
control system using CCD processors Is being conducted. The result is 
to be a system which is capable of recognizing words or phrases spoken 
by an operator for whom It has been previously trained. 

The potential for performing fast and complex processing of speech 
signals with CCD's has generated interest In the possibility of using 
such a voice-actuated system for aviation. Such a system could perform 
simple tasks as, respond! ng to vocal requests about altitude, range, speed, 
etc. 

The investigation has been broken Into two phases. The first ph . 
is the study and simulation on a minicomputer of a speech processing 
technique which could be applicable to CCD Implementation. The second 
phase Is the actual CCD implementation of the system. The initial work 
has Included the collection of Information on the characteristics of 
speech and speech processing. Also computer simulation of some of the 
theory has been conducted. 


Since the scope of this research is limited to applications of OP-SAPS 
to solve pattern recognition problems, we are not doing extensive work in 
feature extraction theory. Hence, an existing algorithm was chosen. 
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Initial literature study and experln»erits led to the conclusion that 
better results might be obtained If feature measurements trom an utterance 
were made In the frequency domain rather than In the time domain. In 
order to el Imlnate phase shift problems such as created by the detection 
of the beginning of an utterance, the frequency Information Is presented 
as the power density spectrum. This concept Is compatible with the use 
of existing laboratory CCD Fourier transform devices. 

The problem now arises as to how much and what type Information Is 
necessary for correct classification. It Is fairly widely accepted that 
systems for speech recognition can be band-limited to around 4 KHz, thereby 
requiring at least an 8 KHz sampling rate. It was also determined that 
a one second Interval Is sufficient for most utterances of Initial Interest. 
These requirements then dictate the processing of 8000 samples per utter- 
ance. In order to accomodate this amount of data with present CCD tech- 
nology, the Interval must be broken Into sub-intervals. The size of each 
sub- Interval Is purely a function of how much frequency resolution is 
necessiry for correct classification. The power density spectrum for 
each sub-interval Is then used to obtain an average power density spectrum 
or perlodogram for the entire utterance. Example perlodograms for the 
words "ON” and "OFF” are shown In Figures 2 and 3, respectively. The 
sub- Interval In each of these examples was 512 samples wide and the 
sampling Interval contained 16 sub- Intervals. With the samp 1 1 ng I nterva I 
approximately one second long, each sub-interval contains 62.5 milliseconds 
of speech and the perlodogram has a resolution of 16 Hz. 

It should be noted that although the amplitude of each power density 
spectrum Is down 20 db or more after approximately 1500 Hz, certain char- 
acteristics of speech In the frequency band from 1500 to 3000 Hz may be 
necessary for the discrimination of certain utterances. 

The next step Is to select a feature extraction scheme for use with 
the perlodograms. One scheme which was Implemented was that of dividing 
the perlodogram Into bands from which the total energy In each band is 
calculated and considered as a feature. Results using a minimum distance 
classifier with this feature vector produced promising but not yet satis- 
factory results. 
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Figure 2 Power density spectrum of "on 
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Figure 3 Power density spectrum of "off 


V?irlations on the feature extraction technique along with oihar con- 
figurations for speech processing using CCD’s are being Investigated. It 
Is felt thai CCD's can play an Important role In speech recognition sys- 
tems . 


3. THEORETICAL STUDY OF A CCD PRa.ESSOR TO CONVERT GREY 
LEVEL INFORMATION TO BLACK AND ^HITE INFORMATION 

Prior research was conducted by the authors at a low level of 
funding for four years under sponsorship of the Air Force Office of 
Scientific Research on the conversion of grey level Information to 
black and white Information, Support stopped approximately one year 
ago but work has continued in the form of a Ph. D. dissertation that is 
being completed on a nonfunded basis. 

We have shown [4] that Information from grey level sensors of a 
particular size may be converted Into black and white Information which 
would be produced by sensors much smaller than the grey level sensors. 

In effect, the resolution has been enhanced. Theoretical examples have 
been worked which Indicate an Increase In resolution of 4 to I [5], The 
limiting conditions have not been established but system complexity 
increases as resolution enhancement Increases. It appears possible 
that CCD’s could be used for the signal processing because of the type 
of data processing to be done and because a means Is needed for processing 
a large amount of data at h>gh ^peed. Such processing may lead to tech- 
niques whereby the ground sampling distance achievable with remote 
sensing may be decreases. 

The basic model of the system results In a non-square matrix which 
needs to be inverted to obtain dosign equations. Of course, a non-square 
matrix cannot he inverted, but a pseudo- Inverse does exist and It has 
been used [6]. Results by Jain ana Angle [7] on similar modeling suggests 
a solution to the design problem using the fast Fourier transform. 

Present efforts are Involved in interpreting a Jain and Angle type 
model in terms of CCD implementable functions. The goal Is to design 
a CCD system for an example problem and predict its performance. The 
cost of conventional hardware in terms of size, power consunption, etc., 
compared to CCD cost factors will br of special concern in the work. 
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